Method and apparatus for dynamic motion analysis

ABSTRACT

In order to determine a physical or physiological condition, a series of images of a human subject in motion are captured ( 1, 2, 3 ). At least one image ( 19 ) is then displayed, and the user selects from a displayed category list ( 8 ) an appropriate category to represent the subject&#39;s condition. The category list represents categories of physical or physiological conditions. A list of treatments for treating the subject ( 5 ) may be displayed, as may a list of possible treatment products, e.g. footwear. Where the treatment products are footwear, there may be a foot measuring device ( 10 ) and other information about the subject ( 5 ) may be stored so as to assist the user in selection of the appropriate footwear products.

BACKGROUND OF THE INVENTION FIELD OF THE INVENTION

The present invention relates to a method and apparatus for use in theanalysis of the dynamics of a human subject, and particularly, thoughnot exclusively, for use in the identification in a human subject of oneor more physical or physiological conditions apparent in, or associatedwith, the walking or running deportment of that subject.

Summary of the Prior Art

The identification and analysis of physical or physiological“conditions” in the feet of human subjects currently relies uponestablished techniques of podiatry or chiropody. Here, physical ailmentsor other conditions are often identified when the human subject isstatic. The subject sits or lies on a bed and a therapist or othertrained practitioner manipulates the subject's feet to discover thedegrees of movement of the ankles, arches and toe areas so as todetermine the variation of the subject from the theoretical normal. Insome instances, measurements of the lower limbs would be taken. Sincethe subject sits or lies during such manipulation, this is a semi weightbearing investigation. The disadvantage of such techniques lie in thedifficulty of identifying ailments or conditions which only becomeapparent, or are more easily identifiable, when the subject is viewedwhen walking or running. In particular, certain conditions or ailmentsmay be best identified at particular instants within the walking orrunning cycle of a subject. In the known techniques, the subject may beasked to stand and walk a few steps. The therapist/practitioner thenwatches the subject and observes weight bearing movement with the nakedeye.

SUMMARY OF THE INVENTION

Where a subject is viewed in a walking or running state, it is generallynot possible to closely and repeatedly scrutinise the dynamics of e.g.the subject's feet at a given instant in time due to the very fact thatthe subject is in motion and such instants are inherently transient.Consequently, the ability to accurately and/or quickly analyse thephysical condition of e.g. the subject's feet is hampered.

The present invention aims to overcome at least some of the deficienciesof the prior art.

At its most general, the invention proposes to capture one or moreimages of at least a subjects feet, in a standing, walking or runningstate, from one or more different perspectives, and to display theimage(s) concurrently with information (e.g. a list) representing anumber categories under which physical conditions identified from theimages may be categorised during analysis of the images.

In this way, the invention aims to enable the accurate yet rapid andsimple identification and categorisation of physical or physiologicalconditions in e.g. the feet of a subject via an analysis of thedeportment of that subject. By viewing the subject images concurrentlywith suitable categorising information, the viewer is able to identifyand analyse physical or physiological conditions in the subject, and tosimultaneously categorise those conditions by selecting suitablecategories from the concurrently displayed category information.

In a first of its aspects, the invention provides a method ofcategorising a human subject comprising the steps of:

-   -   capturing a series of images of said human subject in motion in        the form of image data;    -   providing a category list representing a plurality of categories        of possible physical or physiological conditions in said human        subject;    -   inputting to an image display apparatus said captured image data        and said category list;    -   displaying via said image display apparatus at least one image        from said series of captured images concurrently with said        category list;    -   selecting from said category list one or more of said categories        with which to categorise a respective one or more physical or        physiological condition(s) identified in said human subject from        said displayed at least one image.

The image(s) may be a still image or a sequence of still images, or amoving image sequence which may be “frozen” to provide still images asrequired by the viewer. Preferably, a plurality of such images aresimultaneously displayed, each from a different perspective but capturedat the same instant or over the same time interval. However, images fromdifferent instants, or covering different or partially overlapping timeintervals may be simultaneously displayed.

The images of the subject preferably include one or more front-viewimages of the feet of the subject in a standing or walking or runningstate. Preferably concurrently displayed are images including one ormore rear-view images of the feet of the human subject in a standing orwalking or running state. Thus, a front and rear view of the dynamics ofthe subject may be viewed together. More preferably, the displayedimages include one or more rear-view images of at least the lower spinalarea of the human subject in a standing or walking or running state.Other views of the body of the subject may be displayed instead or inaddition.

The images may be captured by one or more digital cameras for example,although still cameras, video recorders/players or scanners may be used.The camera(s) are preferably connected to, or connectable to, a computerterminal which receives the image data and stores (at least temporarily)that data for display or displays it immediately via the visual displayunit (VDU) of the computer terminal. Thus, in this example, theaforementioned display apparatus is the VDU of the computer terminal,but other display apparatus may be used for displaying the imageswhether digital or otherwise. For example, a TV monitor could be used orimages could even be printed.

In order to obtain the images it is preferable that the human subject iscaused to be in a standing or walking or running state on a treadmill,and the images of the subject are preferably captured while the subjectis in such a state. This enables the dynamics of the subject to beimaged in one convenient location, it obviated the need to move theimage capturing apparatus with the subject or to track the subject. Itmay also be possible for the images to be captured in other situations,such as on a running or athletic track.

This enables the imaging apparatus to be kept in a fixed position suchthat any movement of the subject shown by the captured images will bedue substantially only to the motion of the subject and not to motion ofthe imaging device(s). The speed of walking/running motion can be easilycontrolled by suitably adjusting the speed of the treadmill, and theperspective(s)/view(s) provided by imaging apparatus may be adjusted tosuit the user's needs.

In addition to displaying a category list concurrently with the capturedimages, other related information may be concurrently displayedtherewith. For example, information regarding a number of possibletreatments for physical conditions/ailments listed in the category listmay be displayed. This information may be in the form of a list ofpossible treatments, the list being retrievable by the user as and whenrequired or being automatically presented upon selection by the user ofone of (or a predetermined number of) the categories from the categorylist. Thus, preferably, the method also includes the steps of:

-   -   displaying via said display apparatus a treatment list        representing one or more treatments each associated with one or        more of said one or more categories in said category list; and,    -   selecting from said treatment list one or more treatments.

Furthermore, information regarding a number of treatment products foreffecting the treatment of the physical conditions/ailments listed inthe category list may be displayed. This information may be in the formof a list of possible treatment products, e.g. appropriate footwear, thelist being retrievable by the user as and when required or beingautomatically presented upon selection by the user of one of (or apredetermined number of) the treatments from the treatment list. Thus,preferably, the method includes the steps of:

-   -   displaying via said display apparatus a treatment product list        representing a plurality of treatment products each associated        with one or more of said treatments in said treatment list; and,    -   selecting from said treatment product list one or more treatment        products.

Additional data may be employed in analysing the human subject andpreferably such data includes person data of the physicalcharacteristics of the subject, such as height, age, weight etc. Thus,the method preferably includes the step of acquiring subject datarepresenting physical characteristics of the human subject, inputtingthe acquired data to the display apparatus, and displaying at least someof the acquired data thereby.

Preferably, the acquired data includes at least data relating to thedimensions of the subject's feet, and this data may be acquired from asuitable device connected to the display apparatus (e.g. to a VDU via acomputer terminal) for direct input of that data.

The data representing the category list, treatment list, treatmentproduct list and subject data are preferably stored in a database andare respectively retrieved therefrom prior to being displayed.Preferably, each of the category list, treatment list, treatment productlist and subject data are stored in a separate respective database.

Whilst the display of the image, and the display of the treatment and/orproduct list, may be substantially immediate on the capturing of theimage data, this is not essential. It is possible for the image data tobe stored e.g. on tape, DVD or CD Rom for subsequent display. It is alsopossible for the image data to be transmitted (e.g. via a modem) to aremote site for display.

BRIEF DESCRIPTION OF THE DRAWINGS

There now follows a detailed, but non-limiting, illustration of thepresent invention by way of an example, with reference to the followingdrawings:

FIG. 1 illustrates a schematic representation of apparatus for thedynamic analysis of the motion of a human subject.

DETAILED DESCRIPTION

In FIG. 1, an array of three digital cameras, 1, 2 and 3, are arrayedabout an operating treadmill 4 upon which a human subject 5 located in awalking state sufficient to keep him upon the treadmill. A first digitalcamera, camera 1, is positioned so as to capture digital moving imagesif the rear spinal area at the base of the back of the subject 5, whilesecond and third digital cameras, cameras 2 and 3, are arranged tocapture moving digital images of the rear and front view of the feet ofthe subject respectively.

Each of the three digital cameras 1, 2 and 3 are connected to a computerterminal 6 in such a way as to permit the transfer of digital image datathereto. Thus, digital image data captured by the three cameras iscontinuously input to a computer terminal 6 as the subject 5 walks uponthe treadmill 5. Images of that walking motion are captured by the threecameras as viewed from the front and rear of the subject's feet(illustrating footstrike), and from the base of the subjects back.

The computer terminal 6 subsequently controls the visual display unit(VDU) 7 so as to display the views provided by the images captured bythe three camera array. The three views of the subject 5 are presentedin a regular display format 9 comprising a first view in the form ofmoving images I₁, I₂ and I₃ provided by the first, second and thirddigital cameras 1, 2 and 3 respectively.

Concurrently displayed with the captured image display 9 is a display 8comprising a list representing a plurality of predetermined categoriesof possible physical or physiological conditions in the subject 5.

Data representing the displayed category list is stored in a database 11and input to the computer terminal 6 for display at the VDU 7concurrently with the captured images 9 either automatically or at therequest of the user.

The user is then able to select from the category list 8 one or morecategories with which to categorise a respective one or more physical orphysiological condition(s) identified in the subject 5, the selectionbeing made on the basis of an analysis of the displayed images 9.Selection may be made by, for example, operating user controls 18connected to the computer terminal 6. The user controls may be in theform of known peripheral computer controls such as a “mouse” forcontrolling the position of a control cursor on the VDU screen 7, orcursor control keys on a computer keyboard.

Any number of categories may be chosen from the category list. In orderto assist the analysis of the images 9 of the subject 5, additionalinformation may be displayed with the category list and with thecaptured images 9. This other information may be personal informationrelated to the subject 5 (e.g. age, sex); information conveying certainphysical characteristics of the subject (e.g. weight, height); medicalhistory; the demands of the subject's normal physical activities, if anyfor example, the positional demands of different sporting activities mayaffect the treatment desired. This information is stored in a database12 connected to the computer terminal 6 and is retrievable thereby uponthe command of the user, for display at the VDU 7 of the computer.

Information regarding a number of possible treatments for physicalconditions/ailments listed in the category list may be displayed. Thisinformation may be in the form of a list of possible treatments, thelist being retrievable by the user as and when required or beingautomatically presented upon selection by the user of one of (or apredetermined number of) the categories from the category list. Thetreatment list (not shown) would be presented in a manner similar tothat of category list 8, and would present one or more treatments eachassociated with one or more of the categories in the category list.

Any number of treatments in the list may be selected by the user, thedata representing the treatment list being stored in a database 14, andinput to computer the terminal 6 for display at the VDU 7 of thecomputer at the command of the user. Upon selecting a (or apredetermined number of) treatments from the treatment list, informationregarding a number of treatment products for effecting the treatment ofthe physical conditions/ailments listed in the category list may bedisplayed. This information may be in the form of a list of possibletreatment products and displayed in the manner of display 8. The listmay be retrievable by the user as and when required or may beautomatically presented upon selection by the user of one of (or apredetermined number of) the treatments from the treatment list. Thetreatment products are, for example, footwear and the list may be splitinto categories representing use, foot function, joint type,manufacturer, style and cost.

In the treatment product list, the treatment products are eachassociated with one or more of said treatments in said treatment list,and the user may select from the treatment product list any number oftreatment products.

Moreover, particularly where the treatment products are footwear, it ispossible for the treatment product list to be divided into differentcategories to enable the user more readily to select from that list.Footwear may be divided into last types and length and width fittings,but may also be divided into the different purposes to which thefootwear are to be put, such as running, walking, or other sport-relatedactivities as have previously been mentioned, the user may be presentedwith information indicating the subject's normal physical activities, orsports activities of the subject, and the division of the list intodifferent categories then facilitate the selection of the appropriateproduct.

Additional data may be input to the computer terminal 6 so as to assistin the analysis of the dynamic motion of the subject 5. Such dataincludes data relating to the dimensions of the subject's feet, and thisdata being acquired from a suitable foot measuring device 10 connectedto the VDU 7 via the computer terminal for direct input of that data andsubsequent display. The data from the foot measuring device 10 may beconverted to footwear sizing in any appropriate sizing systems. Sizingmay include both length and width information. The data may also includeinformation about the subject's normal physical activities and anysporting activity.

Many variations on the above embodiment are possible within the scope ofthe present invention. For example, the subject may be marked with dotsor lines so that the movements can be more clearly seen, and thus aidanalysis and diagnosis. It is possible to store the images for suchretrieval, and possibly comparison with current images. This enablesimprovements, deteriorations, physical changes through injury, ororthotic wearing to be identified. It is also then possible to takemeasurements when the subject is barefoot, and when they are wearingdifferent types of footwear, to observe the different effects. This alsoenables the effects on gait of different footwear, bodyloadings, etc. tobe observed.

Moreover, the selected treatment, or treatment product may be printed bythe apparatus, together with appropriate personal information of thesubject, as a permanent record of the selection.

1. A method of categorizing a human subject comprising the steps of:capturing a series of images of said human subject in motion in the formof image data; providing a category list representing a plurality ofcategories of possible physical or physiological conditions in saidhuman subject; inputting to an image display apparatus said capturedimage data and said category list; displaying via said image displayapparatus at least one image from said series of captured imagesconcurrently with said category list; selecting from said category listone or more of said categories with which to categorize a respective oneor more physical or physiological condition (s) identified in said humansubject from said displayed at least one image.
 2. A method according toclaim 1, wherein the method includes the steps of: displaying via saiddisplay apparatus a treatment list representing one or more treatmentseach associated with one or more of said one or more categories in saidcategory list; and, selecting from said treatment list one or moretreatments.
 3. A method according to claim 2, wherein the methodincludes the steps of: displaying via said display apparatus a treatmentproduct list representing a plurality of treatment products eachassociated with one or more of said treatments in said treatment list;and, selecting from said treatment product list one or more treatmentproducts.
 4. A method according to claim 1, wherein the treatmentproducts are footwear.
 5. A method according to claim 1, wherein themethod includes the step of acquiring subject data representing physicalcharacteristics of the feet of the human subject, inputting saidacquired data to said display apparatus, and displaying said acquireddata thereby.
 6. A method according to any claim 1, wherein the methodincludes the step of inputting to said display apparatus subject datarepresenting predetermined characteristics of the human subject, anddisplaying at least some of said subject data via said displayapparatus.
 7. A method according to claim 2, wherein data representingsaid treatment list is stored in a database and is retrieved therefromprior to said displaying thereof.
 8. A method according to claim 3,wherein data representing said treatment product list is stored in adatabase and is retrieved therefrom prior to said displaying thereof. 9.A method according to claim 6 wherein said subject data is stored in adatabase and is retrieved therefrom prior to said displaying thereof.10. A method according to claim 1, wherein said images include one ormore front-view images of the feet of the human subject in a standing orwalking or running state.
 11. A method according to claim 1 wherein,said images include one or more rear-view images of the feet of thehuman subject in a standing or walking or running state.
 12. A methodaccording to claim 1 wherein, said images include one or more rear-viewimages-of at least the lower spinal area of the human subject in astanding or walking or running state.
 13. A method according to claim 1,wherein said human subject is caused to be in a standing or walking orrunning state on a treadmill, and said images of said human subjectinclude images captured while said human subject is in such a state. 14.Apparatus for use in categorizing a human subject, the apparatuscomprising: an image capturer for capturing in the form of image data aseries of images of said human subject in motion; a data store forstoring a category list representing a plurality of categories ofpossible physical or physiological conditions in said human subject; animage display for receiving said image data from said image capturer andfor receiving said category list from said data store, and fordisplaying said at least one of said images concurrently with saidcategory list so as to permit the selecting from said category list oneor more of said categories with which to categorize a respective one ormore physical or physiological condition (s) identified in said humansubject from said displayed at least one image.
 15. Apparatus accordingto claim 14, further including a data store for storing a treatment listrepresenting one or more treatments each associated with one or more ofsaid one or more categories in said category list, said image displaybeing operable to display said treatment list.
 16. Apparatus accordingto claim 15, further including a data store for storing a treatmentproduct list representing one or more treatment products each associatedwith one or more of said one or more treatments in said treatment list,said image display being operable to display said treatment productlist.
 17. Apparatus according to claim 14, further including footmeasuring means for acquiring subject data representing physicalcharacteristics of the feet of the human subject, and for inputting saidacquired data to said display apparatus for display thereby. 18.Apparatus according to claim 14, further comprising a data store forstoring subject data representing predetermined physical characteristicsof the human subject, said image display being operable to display atleast some of said subject data.
 19. Apparatus according to claim 15,further including a database in which said treatment list is stored. 20.Apparatus according to claim 16 further including a database in whichsaid treatment product list is stored.
 21. Apparatus according to claim18 further comprising a database in which said subject data is stored.22. Apparatus according to claim 14 wherein said image capturer isoperable to capture one or more front-view images of the feet of thehuman subject in a standing or walking or running state.
 23. Apparatusaccording to claim 14 wherein, said image capturer is operable tocapture one or more rear-view images of the feet of the human subject ina standing or walking or running state.
 24. Apparatus according to claim14 wherein, said image capturer is operable to capture one or morerear-view images of at least the lower spinal area of the human subjectin a standing or walking or running state.
 25. Apparatus according toclaim 14 further including a treadmill wherein, and said image captureris operable to capture images of said human subject while said humansubject is upon said treadmill and in a standing or walking or runningstate.